Skip to content

Comments

docs: update runner and architecture compatibility#992

Open
Mossaka wants to merge 1 commit intomainfrom
docs/runner-compatibility
Open

docs: update runner and architecture compatibility#992
Mossaka wants to merge 1 commit intomainfrom
docs/runner-compatibility

Conversation

@Mossaka
Copy link
Collaborator

@Mossaka Mossaka commented Feb 21, 2026

Summary

Update docs/compatibility.md with the full runner support matrix based on extensive testing.

Changes

  • Add comprehensive GitHub Actions runner table with all tested configurations
  • Upgrade ARM64 (ubuntu-24.04-arm) from "May Work" to "Fully Supported"
  • Add macOS and Windows runners as explicitly not supported with reasons
  • Add "Why macOS runners are not supported" section explaining the nested virtualization limitation

🤖 Generated with Claude Code

Update the compatibility matrix with tested runner configurations:
- ubuntu-24.04-arm (ARM64) now fully supported
- macOS runners explicitly marked as not supported with explanation
- Windows runners marked as not supported
- ARM64 architecture upgraded from "May Work" to "Fully Supported"

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings February 21, 2026 01:13
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the compatibility documentation (docs/compatibility.md) to provide a comprehensive runner support matrix for GitHub Actions. The main goal is to clarify which GitHub Actions runners are supported by the Agentic Workflow Firewall (AWF).

Changes:

  • Converted the GitHub Actions runner section from a simple list to a detailed table showing runner name, architecture, support status, and notes
  • Upgraded ARM64 support status (ubuntu-24.04-arm) from "⚠️ May Work" to "✅ Fully Supported"
  • Added explicit "Not Supported" entries for macOS and Windows runners with technical justifications
  • Added a new section explaining why macOS runners cannot support AWF due to nested virtualization limitations
Comments suppressed due to low confidence (1)

docs/compatibility.md:42

  • The claim that ubuntu-24.04-arm is "Fully Supported" appears inconsistent with the CI configuration. After searching all workflow files in .github/workflows/, no workflows are currently configured to run on ubuntu-24.04-arm runners. The codebase only builds multi-architecture container images (amd64 and arm64) in the release workflow, but does not actually test AWF functionality on ARM64 runners.

To make this claim accurate, either:

  1. Add CI workflows that test on ubuntu-24.04-arm runners (e.g., update test-action.yml, test-coverage.yml, or smoke tests to include an ARM64 matrix entry), or
  2. Downgrade the status to "⚠️ May Work" with a note like "Multi-arch containers are built but not actively tested on ARM runners" until actual CI testing is in place.

The current "Fully Supported" designation suggests active CI testing and validation, which could be misleading to users.

| `ubuntu-24.04-arm` | arm64 | ✅ Fully Supported | Linux ARM64. Docker, AWF, and MCP Gateway all work. |

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

|--------------|--------|-------|
| x86_64 (amd64) | ✅ Fully Supported | Primary development platform |
| arm64 (aarch64) | ⚠️ May Work | Not actively tested |
| arm64 (aarch64) | ✅ Fully Supported | Tested on `ubuntu-24.04-arm` GitHub Actions runners |
Copy link

Copilot AI Feb 21, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The note "Tested on ubuntu-24.04-arm GitHub Actions runners" is not supported by evidence in the codebase. No CI workflows are configured to run on ARM runners, and there's no test output or workflow history included that demonstrates successful ARM64 testing.

Consider revising to accurately reflect the testing status, such as: "Multi-arch containers built; manual testing required" or provide evidence of the testing (e.g., workflow runs, test results) if it was done outside the repository's CI system.

This issue also appears on line 42 of the same file.

Copilot uses AI. Check for mistakes.
@github-actions
Copy link
Contributor

Build Test: Deno Results

Project Tests Status
oak 1/1 ✅ PASS
std 1/1 ✅ PASS

Overall: ✅ PASS

Generated by Build Test Deno for issue #992

@github-actions
Copy link
Contributor

Node.js Build Test Results

Project Install Tests Status
clsx PASS
execa PASS
p-limit PASS

Overall: PASS 🎉

Generated by Build Test Node.js for issue #992

@github-actions
Copy link
Contributor

Rust Build Test Results

Project Build Tests Status
fd 1/1 PASS
zoxide 1/1 PASS

Overall: PASS

Generated by Build Test Rust for issue #992

@github-actions
Copy link
Contributor

Smoke Test Results — Claude (run #22247387859)

✅ GitHub MCP: #975 chore: remove _codeql_detected_source_root, #977 fix: add iptables bypass for container self-traffic
✅ Playwright: github.com title contains "GitHub"
✅ File write: /tmp/gh-aw/agent/smoke-test-claude-22247387859.txt created
✅ Bash verify: file read back successfully

Overall: PASS

💥 [THE END] — Illustrated by Smoke Claude for issue #992

@github-actions
Copy link
Contributor

Bun Build Test Results

Project Install Tests Status
elysia 1/1 PASS
hono 1/1 PASS

Overall: PASS 🎉

Bun v1.3.9 — ran on workflow #22247387896

Generated by Build Test Bun for issue #992

@github-actions
Copy link
Contributor

Build Test: Bun Results ✅

Project Install Tests Status
elysia 1/1 PASS
hono 1/1 PASS

Overall: PASS

Bun version: 1.3.9

Generated by Build Test Bun for issue #992

@github-actions
Copy link
Contributor

Smoke Test Results@Mossaka

Test Result
GitHub MCP (last 2 PRs: #984, #981)
Playwright (github.com title check)
File write + bash verify

Overall: PASS

📰 BREAKING: Report filed by Smoke Copilot for issue #992

@github-actions
Copy link
Contributor

Build Test: Node.js Results

Project Install Tests Status
clsx PASS
execa PASS
p-limit PASS

Overall: ✅ PASS

Generated by Build Test Node.js for issue #992

@github-actions
Copy link
Contributor

Deno Build Test Results

Project Tests Status
oak 1/1 ✅ PASS
std 1/1 ✅ PASS

Overall: ✅ PASS

Generated by Build Test Deno for issue #992

@github-actions
Copy link
Contributor

chore: remove _codeql_detected_source_root
fix: add iptables bypass for container self-traffic
Tests 1-4: ✅ GH MCP merged PRs | ✅ safeinputs gh pr list | ✅ Playwright title | ❌ Tavily search
Tests 5-8: ✅ file write | ✅ cat verify | ✅ discussion comment | ✅ build
Overall: FAIL

🔮 The oracle has spoken through Smoke Codex for issue #992

@github-actions
Copy link
Contributor

Go Build Test Results

Project Download Tests Status
color PASS ✅ PASS
env PASS ✅ PASS
uuid PASS ✅ PASS

Overall: ✅ PASS

Generated by Build Test Go for issue #992

@github-actions
Copy link
Contributor

.NET Build Test Results

Project Restore Build Run Status
hello-world PASS
json-parse PASS

Overall: PASS

Run output

hello-world:

Hello, World!
```

**json-parse:**
```
{
  "Name": "AWF Test",
  "Version": 1,
  "Success": true
}
Name: AWF Test, Success: True

Generated by Build Test .NET for issue #992

@github-actions
Copy link
Contributor

Smoke Test Results (Claude claude-sonnet-4-6)

✅ GitHub MCP: #984 fix: prevent agent from accessing host git credentials, #975 chore: remove _codeql_detected_source-root
✅ Playwright: github.com title contains "GitHub"
✅ File write: /tmp/gh-aw/agent/smoke-test-claude-22247480589.txt created
✅ Bash verify: file contents confirmed

Overall: PASS

💥 [THE END] — Illustrated by Smoke Claude for issue #992

@github-actions
Copy link
Contributor

Java Build Test Results

Project Compile Tests Status
gson 1/1 PASS
caffeine 1/1 PASS

Overall: ✅ PASS

Generated by Build Test Java for issue #992

@github-actions
Copy link
Contributor

🦀 Rust Build Test Results

Project Build Tests Status
fd 1/1 PASS
zoxide 1/1 PASS

Overall: ✅ PASS

Generated by Build Test Rust for issue #992

@github-actions
Copy link
Contributor

C++ Build Test Results

Project CMake Build Status
fmt PASS
json PASS

Overall: PASS

Generated by Build Test C++ for issue #992

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant